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(57) A driving mental condition detecting apparatus 
for detecting a deterioration state of driving mental con- 
ditions such as sleepiness, fatigue, and impatience 
occurring in a driver on the basis of physiological data 



detected from the driver and road travel data of a vehicle 
derived from a navigation system, thereby generating an 
alarm. 
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Description 

BACKGROUND OF THE INVENTION 

5 1 . Field of the Invention 

The invention relates to a driving mental condition detecting apparatus for detecting a driving mental condition of a 
driver during the driving of a vehicle. 

w 2. Description of the Related Background Art 

In recent years, there has been developed a driving mental condition detecting apparatus for detecting a deteriorated 
state of a driver during the driving of a vehicle, namely, a sleepiness, a fatigue, an impatience, or the like and informing 
the driver of the detected condition, thereby urging a safety driving. 
is in such a driving mental condition detecting apparatus, physiological data such as heartbeat, skin electric reaction 
and wink is obtained from the driver during the driving of the vehicle and mental conditions such as sleepiness, fatigue 
and impatience are judged on the basis of the physiological data. 

In a situation during the driving of the vehicle, however, there is a problem such that an accurate judgment is not 
performed according to such a judging method of the mental conditions using only the physiological data. 

20 

SUMMARY OF THE INVENTION 

The invention is made to solve the above problem and it is an object of the invention to provide a driving mental 
condition detecting apparatus which can accurately detect driving mental conditions of the driver during the driving of a 
25 vehicle. 

A driving mental condition detecting apparatus according to the present invention comprises: physiological data 
detecting means for detecting physiological data of a driver of a vehicle; navigation means for obtaining travel data of 
the vehicle; driving mental condition judging means for judging whether the driving mental conditions of the driver have 
deteriorated or not on the basis of- the physiological data and the travel data; and alarm generating means for generating 
30 an alarm when it is judged that the driving mental conditions deteriorated. 

On the basis of the physiological data detected from the driver and the road travel data of the vehicle obtained from 
the navigation means, the deteriorated state of the driving mental conditions such as sleepiness, fatigue, and impatience 
occurring in the driver is detected, thereby generating an alarm, 

35 BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a diagram showing a construction of a car accessary system to which a driving mental condition detecting 
apparatus according to the invention is applied; 

Fig. 2 is a diagram showing an example of a construction of a navigation system; 
40 Fig. 3 is a diagram showing an example of an adhesion forming style of an MT pickup; 

Fig. 4 is a diagram showing an internal construction of a heartbeat detecting circuit; 

Figs. 5A to 5E is a diagram showing a signal waveform that is generated from each component module of the 
heartbeat detecting circuit; 

Fig. 6 is a diagram showing an example of an internal construction of a BPF; 
45 Fig. 7 is a diagram showing cut-off characteristics of an HPF and an LPF; 

Fig. 8 is a diagram showing an example of a circuit construction of the heartbeat detecting circuit; 

Fig. 9 is aflowchart showing a main flow of the driving mental condition detecting operation according to the invention; 

Fig. 10 is a flowchart showing a main flow of the driving mental condition detecting operation according to the 

invention; 

so Fig. 1 1 is a diagram showing a memory map of an RAM; 

Fig. 12 is a flowchart showing a subroutine flow for a judgment of a sleepiness; 

Fig. 13 is a flowchart showing a subroutine flow for a judgment of a fatigue; 

Fig. 14 is a flowchart showing a subroutine flow for a judgment of an impatience; 

Fig. 15 is a diagram showing an example of another attachment style of the MT pickup; 
55 Fig. 1 6 is a diagram showing an example of still another attachment style of the MT pickup; 

Fig. 17 is a diagram showing an example of further another attachment style of the MT pickup; 

Fig. 18 is a diagram showing another embodiment of the heartbeat detecting circuit; 

Fig. 19 is a diagram showing still another embodiment of the heartbeat detecting circuit; and 

Fig. 20 is a diagram showing further another embodiment of the heartbeat detecting circuit. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Fig. 1 is a diagram showing a construction of a car accessary system to which a driving mental condition detecting 
apparatus according to the invention is supplied. 
5 In Fig. 1, an audio system 1 is what is called a car audio system comprising component elements such as a CD 

player, a tuner, a cassette deck, an equalizer, an amplifier, and speakers. The operations of the component elements in 
the audio system 1 are controlled in accordance with not only various kinds of operations by an operator but also various 
operation instruction signals which are supplied through a CPU bus 100 connected to a CPU 1 1 . 

An air conditioner 2 is a car air conditioner to adjust a temperature and a humidity in the room of the vehicle. The 
w air conditioner 2 has a temperature sensor to detect the temperature in the room of the vehicle and automatically adjusts 
the temperature in the vehicle room to a predetermined set temperature on the basis of a detected temperature which 
is derived from the temperature sensor. Namely, a cool wind or a hot wind is blown into the room through blowing opening 
ports until the detected temperature is equal to a predetermined set temperature. The operation including the automatic 
temperature adjusting operation of the air conditioner system 2 is controlled in accordance with various operation instruc- 
75 tion signals which are supplied through the CPU bus 100. The air conditioner system 2 transmits the detection temper- 
ature information obtained from the temperature sensor to the CPU bus 100. 

A navigation system 3 is a car navigation system for navigating the vehicle to a predetermined target location by 
detecting the present location of the vehicle and displaying the detected present location on a display by linking with 
map information. 

20- Fig. 2 is a diagram showing an example of a construction of the navigation system 3. 

In Fig. 2, a geomagnetism sensor 31 detects a geomagnetism (magnetic field of the earth) state at the present 
location of the vehicle, generates azimuth information corresponding to a progressing azimuth of the vehicle on the basis 
of the detected geomagnetism state, and supplies it to a system controller 32. A GPS (Global Positioning System) 33 
receives present time information that is supplied from a time measuring timer 34 and distance measurement signals 

25 which are transmitted from a plurality of GPS satellites, measures a latitude and a longitude at the present location of 
the vehicle, and supplies latitude and longitude information to the system controller 32. A speed and travel distance 
measuring apparatus 35 measures a running speed of the vehicle and an accumulated travel distance from the engine 
start point of the vehicle, and supplies the running speed and accumulated travel distance information to the system 
controller 32. In addition to the distance measurement signal as position information, time date Is also included in the 

30 signal that is transmitted from the GPS satellite. Thus, by obtaining the present time from the time data, the time meas- 
uring timer 34 is unnecessary. If the accumulated travel distance from the engine start point of the vehicle is calculated 
from the start position and the present location and the speed of the vehicle is calculated as an average speed in a 
certain interval from the travel distance and the elapsed time of the interval, the speed and travel distance measuring 
apparatus 35 is unnecessary. 

35 A CD-ROM player 36 reads recording information from a recording disk on which map information and various kinds 

of road information have been recorded, obtains reproduction map information and road information, and supplies them 
to the system controller 32. 

The system controller 32 counts the number of azimuth changing times of the vehicle on the basis of the azimuth 
information supplied from the geomagnetism sensor 31 and stores it into an azimuth and speed changing times memory 

40 37. The system controller 32 counts the number of changing times of the acceleration or deceleration of the vehicle on 
the basis of the running speed information supplied from the speed and travel distance measuring apparatus 35 and 
stores the count value into the memory 37. The system controller 32 further calculates the coordinates of the present 
location of the vehicle on a map on the basis of the azimuth, latitude and longitude information supplied from the geo- 
magnetism sensor 31 and GPS 33 and supplies to a display 38 a video signal obtained by mixing a video signal such 

45 that an own vehicle location mark is displayed at the present location coordinate position and a video signal corresponding 
to the reproduction map information. On the basis of the present location coordinates and the reproduction map infor- 
mation, the system controller 32 judges a running road on which the vehicle is running at present. In the system controller 
32, the road information corresponding to the running road decided as mentioned above is extracted from the road 
information supplied from the CD-ROM player 36 and transmitted as present running road information to the CPU bus 

so 1 00. For example, identification information to distinguish a freeway and a general road can be mentioned as such road 
information. When it is judged that the road on which the vehicle is running at present is the freeway, the system controller 
32 transmits the present running road information of a logic value "1" to the CPU bus 100. On the other hand, when it 
is judged that the present running road is the general road, the system controller 32 transmits the present running road 
information of a logic value "0" to the CPU bus 100. 

55 In accordance with various read instruction signals supplied from the CPU bus 100, the system controller 32 reads 

out the information regarding the number of azimuth changing times of the vehicle and the number of speed changing 
times of the vehicle which have been stored in the memory 37 and transmits them to the CPU bus 100. Further, the 
system controller 32 transmits the present time information and the accumulated travel distance information to the CPU 
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bus 100 in accordance with the various read instruction signals supplied from the CPU bus 100, The display 38 displays 
an image based on the video signal supplied. 

An alarm sound generating apparatus 4 in Fig. 1 generates an alarm message, by a voice, corresponding to an 
alarm voice instruction signal that is supplied through the CPU bus 100. A display 5 displays the alarm message corre- 

5 sponding to an alarm display instruction signal that is supplied through the CPU bus 100. A perfume (smell) generating 
apparatus 6 generates a perfume with a stimulus into the room of the vehicle in accordance with a perfume generation 
instruction signal that is supplied through the CPU bus 100. A sleepiness time zone setting switch 7 generates a sleep- 
iness time zone set request signal in accordance with a switching operation by a driver and transmits to the CPU bus 
100. When the driver is conscious of a sleepiness by himself, he pushes the sleepiness time zone setting switch 7. 

w An MT (Minor Tremor) pickup 8 is attached on a seat belt equipped with the driver's seat. The MT pickup 8 detects 
a skin vibration level of approximately 1 to 10 microns occurring on the skin surface of the driver and supplies a skin 
vibration signal corresponding to the detected skin vibration level to a heartbeat detecting circuit 9. 
Fig. 3 is a diagram showing an example of an attaching style of the MT pickup 8. 

In Fig. 3, a pickup fixing ring 82a is movably attached to a seat belt 82 equipped with a driver's seat 81 . The MT 
75 pickup 8 is fixed on the pickup fixing ring 82a. A transmission cable for transmitting the skin vibration signal derived from 
the MT pickup 8 is connected to a seat belt buckle 82c through an expandable bellows member 82b surrounded the 
seat belt 82. Namely, the skin vibration signal generated from the MT pickup 8 is supplied to the heartbeat detecting 
circuit 9 through the seat belt buckle 82c. 

When the seat belt 82 is fastened, the driver adjusts the pickup fixing ring 82a so that the skin vibration detecting 
20 surface of the MT pickup 8 is located at a position where it is come into contact with the driver. The MT pickup 8 doesn't 
need to directly touch the body of the driver. That is, it is sufficient that the skin vibration detecting surface of the MT 
pickup 8 is touched the driver through cloths and the seat belt 82. 

The heartbeat detecting circuit 9 generates a heartbeat signal corresponding to the heartbeat of the driver on the 
basis of the supplied skin vibration signal and transmits the heartbeat signal to the CPU bus 100. 
25 Fig. 4 is a diagram showing an internal construction of the heartbeat detecting circuit 9. Figs. 5A to 5E are diagrams 

showing signal waveforms that are generated from respective component modules of the heartbeat detecting circuit 9. 

In Fig. 4, an amplifier 91 amplifies a signal level of the skin vibration signal from which a high frequency noise 
component of the supplied skin vibration signal is eliminated, and supplies the amplified skin vibration signal (a) to a 
BPF (Band Pass Filter) 92. The BPF 92 is a band pass filter constructed so as to pass a component of 10 [Hz] of the 
30 amplified skin vibration signal (a). A passed skin. vibration signal (b) is supplied to a peak holding circuit 93. 
Fig. 6 is a diagram showing an example of an internal construction of the BPF 92. 

In Fig. 6. an HPF (High Pass Filter) 92a is a high pass filter having a cut-off frequency fc = 1 1 .3 [Hz] and its cut-off 
characteristics are shown by a solid line A in Fig. 7. An LPF (Low Pass Filter) 92b is a low pass filter having a cut-off 
frequency fc = 8.0 [Hz] and its cut-off characteristics are shown by a solid line B in Fig. 7. According to the construction 
35 of the BPF 92 as shown in Fig. 6, therefore, the skin vibration signal (b) comprising band components shown as a 
hatched portion in Fig. 7 is supplied to the peak holding circuit 93. 

The peak holding circuit 93 generates a heartbeat signal (c) having an envelope waveform derived by holding each 
level peak value of the skin vibration signal (b). A time constant of the peak holding operation is set to, for example, 0.1 
[second]. An LPF 94 obtains a heartbeat signal (d) from which noise components multiplexed to the heartbeat signal 
40 (c) are eliminated and supplies the heartbeat signal (d) to an A/D converter 95. For example, a cut-off frequency fc of 
the LPF 94 is set to fc = 5.3 [Hz]. The A/D converter 95 samples the heartbeat signal d at a predetermined sampling 
timing, converts the sampled signal into a digital heartbeat signal (e) and transmits it to the CPU bus 100. 

Namely, in the heartbeat detecting circuit 9, since the signal corresponding to the heartbeat has been multiplexed 
to a component of about 10 [Hz] in the skin vibration signal, the component of about 10 [Hz] is extracted from the skin 
45 vibration signal, and an envelope waveform signal derived by holding a level peak value of the extracted signal is set to 
a heartbeat signal corresponding to the heartbeat. 

The reason why the cut-off frequency of the LPF 94 is so low to be 5.3 [Hz] as compared with that the desired signal 
includes a component of about 10 [Hz] in the skin vibration signal is because the LPF 94 is constructed by an analog 
circuit and such an analog filter has smooth cut-off characteristics, so that although the desired 10 [Hz] component 
so slightly attenuates, a value such that an effect of a noise component elimination is larger than it is selected. That is, it 
is sufficient to set the cut-off frequency of the LPF 94 to a value such that the noise components can be effectively 
eliminated while sufficiently passing a desired frequency component. 

Fig. 8 is a diagram showing an example of a circuit construction to realize the heartbeat detecting circuit 9 as shown 
in Fig. 4. 

55 As mentioned above, in a heartbeat measuring apparatus comprising the MT pickup 8 and heartbeat detecting 
circuit 9, the skin vibration of approximately 1 to 1 0 microns occurring on the skin surface of the driver is detected through 
the cloths of the driver and the seat belt 82 and the envelope waveform signal derived by holding the level peak value 
of the skin vibration signal corresponding to the skin vibration is derived as a heartbeat signal corresponding to the 
heartbeat. 
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According to such a heartbeat measuring apparatus, therefore, even when electrodes for detecting a heartbeat are 
not directly attached to a chest portion or a finger tip of the driver, the heartbeat can be measured. 

A DSP (Digital Signal Processor) 10 in Fig. 1 executes an FFT (Fast Fourier Transformation) process to an RR 
signal supplied through the CPU bus 100 and measures a component of 0.05 to 0.15 [Hz] and a component of 0.15 to 

5 0.4 [Hz] in the RR signal, respectively. The DSP 10 transmits the 0.05 to 0.15 [Hz] component in the RR signal as an 
MWSA (Mayer Wave related Sinus Arrhythmia) value and a 0.15 to 0.4 [Hz] component as an RSA (Respiratory Sinus 
Arrhythmia) value to the CPU bus 100. 

The RR signal is a signal obtained by time-serializing each heartbeat interval of the heartbeats. For example, the 
signal obtained by time-serializing each of heartbeat intervals RR1 to RR5 of the heartbeat signal (d) as shown in Fig. 

w 5D is the RR signal. The MWSA value indicates a fluctuation of the heartbeat interval regarding a respiratory motion 
and it is known that the MWSA value is used as an activity index of the sympathetic system. The RSA value indicates 
a fluctuation of the heartbeat intervals regarding a blood pressure fluctuation and it is known that the RSA value is used 
as an activity index of the parasympathetic system. 

A CPU (Central Processing Unit) 1 1 reads the foregoing various kinds of signals supplied to the CPU bus 100 in 

is accordance with a driving mental condition detecting procedure stored in an ROM (Read Only Memory) 1 2 and transmits 
various kinds of instruction signals to the CPU bus 1 00. An RAM (Random Access Memory) 1 3 stores various information 
that is formed as intermediate data upon execution of the driving mental condition detecting procedure. 

Figs. 9 and 10 are flowcharts showing a main flow for detection of the driving mental condition which is executed 
by the CPU 1 1 in response to an engine start of the vehicle. Fig. 1 1 is a diagram showing a memory map in the RAM 

20 13 for storing various information that is formed as intermediate data upon execution of the main flow. 

First, the CPU 1 1 reads the present time information from the navigation system 3 and stores the read present time 
information as departure time Ts into an address *'A1" in the RAM 13 (step S1). Subsequently, the CPU 1 1 executes an 
RR measuring subroutine to measure a heartbeat interval RR of the heartbeat signal (step S2). In the RR measuring 
subroutine, the CPU 1 1 measures each heartbeat interval RR of the heartbeat signal for only a predetermined time on 

25 the basis of each sample value of the digital heartbeat signal (e), as shown in Fig. 5E, supplied from the heartbeat 
detecting circuit 9 and sequentially stores the measured heartbeat intervals RR into memory addresses after an address 
"C1" in the RAM 13. For example, the CPU 11 first sequentially detects a transition time point at which each sample 
value of the digital heartbeat signal (e) changes from an increasing tendency to a decreasing tendency. When each 
sample value of the digital heartbeat signal e doesn't change to the increasing tendency for an interval of 0.5 second 

30 from the transition detection time point, it is judged that the above transition detection time point is a signal peak timing. 
The CPU 1 1 subsequently sets a time interval of the adjacent signal peak timings judged to the heartbeat interval RR 
and sequentially stores them into the memory addresses after the address "d" in the RAM 13. : 

After completion of the execution of the RR measuring subroutine, the CPU 1 1 starts to execute a heartbeat number 
calculating subroutine to obtain the number of heartbeats (step S3). In the heartbeat number calculating subroutine, the 

35 CPU 11 calculates the number of heartbeats per unit time on the basis of the heartbeat interval RR stored ia.each 
memory address after the "C1" address in the RAM 13 and stores the calculated number of heartbeats as an initial 
heartbeat number HRs into an address "A2" in the RAM 13. The total number of samples of the heartbeat intervals RR 
stored in the addresses after the "C1" address in the RAM 13 is divided by the total value of the heartbeat intervals 
obtained by adding the heartbeat intervals RR, so that the number of heartbeats per unit time can be obtained. After 

40 completion of the execution of the heartbeat number calculating subroutine, the CPU 1 1 starts to execute an RR meas- 
uring subroutine to measure the heartbeat interval RR of the heartbeat signal (step S4). Since the RR measuring sub- 
routine are the same as the operation executed in step S2, its detailed description is omitted. 

After completion of the execution of the RR measuring subroutine in step S4, the CPU 11 starts to execute the 
heartbeat number calculating subroutine to obtain the number of heartbeats (step S5). In the heartbeat number calcu- 

45 lating subroutine, the CPU 1 1 calculates the number of heartbeats per unit time on the basis of the heartbeat interval 
RR stored in each memory address after the "C1" address in the RAM 13 and stores the calculated heartbeat number 
as a present heartbeat number HR into an address "A3" in the RAM 13. After completion of the execution of the heartbeat 
number calculating subroutine in step S5, the CPU 1 1 sequentially reads the heartbeat intervals RR stored in the memory 
addresses after the "C1" address in the RAM 13 and transfers them as an RR signal to the DSP 10 (step S6). By 

so executing step S6, the DSP 1 0 executes the FFT process to the RR signal and transmits the 0.05 to 0. 1 5 [Hz] component 
in the RR signal as an MWSA value and the 0.1 5 to 0.4 [Hz] component as an RSA value to the CPU bus 100. The CPU 
1 1 fetches the MWSA value and RSA value, stores the MWSA value into an address "A4" in the RAM 13, and stores 
the RSA value into an address "A5" in the RAM 13 (step S7). 

After that, the CPU 1 1 reads the present time information from the navigation system 3 and stores the read present 

55 time information as a present time T into an address "A6" in the RAM 13 (step S8). Subsequently, the CPU 1 1 reads 
each of the present time T stored in the address "A6" in the RAM 13 and the departure time Ts stored in the address 
"A1" in the RAM 13 and subtracts the departure time Ts from the present time T, thereby obtaining a continuous driving 
time S and storing into an address "A7" in the RAM 13 (step S9). The CPU 11 reads the information of the number of 
azimuth changing times of the vehicle from the navigation system 3, divides the number of azimuth changing times of 
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the vehicle which was read, by the continuous driving time S stored in the address "A7" in the RAM 13, and stores the 
inverse number of the division result into an address "A8" in the RAM 13 as azimuth distribution parameter 1/aa (step 
S10). The CPU 11 reads the information of the number of speed changing times of the vehicle from the navigation 
system 3, divides the read number of speed changing times of the vehicle by the continuous driving time S stored in the 

5 address "A7" in the RAM 13, and stores the inverse number of the obtained division result into an address "A9" in the 
RAM 13 as a speed distribution parameter 1/ou (step S1 1). 

The CPU 1 1 reads the accumulated travel distance information from the navigation system 3 and stores the read 
accumulated travel distance as a movement distance L into an address "AA" in the RAM 13 (step S12). The CPU 1 1 
reads the present running road information from the navigation system 3 and stores the read present running road 

w information as present running road information D into an address "AB" in the RAM 13 (step S13). After completion of 
step S13, the CPU 1 1 executes a sleepiness judging subroutine (step S14). 
Fig. 12 is a flowchart showing a sleepiness judging subroutine. 

In Fig. 12, the CPU 1 1 first judges whether a sleepiness time zone set request signal has been transmitted from 
the sleepiness time zone setting switch 7 or not (step S91). In step S91 , when it is judged that the sleepiness time zone 

15 set request signal has been transmitted, the CPU 1 1 reads the present time T stored in the address "A6" in the RAM 
13 and stores the time information obtained by subtracting 0.5 hour from the present time T into an address "AC" in the 
RAM 13 as a sleepiness occurrence time T1 (step S92). The CPU 11 stores the time information obtained by adding 
0.5 hour to the present time T into address "AD" in the RAM 13 as a sleepiness occurrence time T2 (step S93). After 
completion of step S93 or if it is judged in step S91 that the sleepiness time zone set request signal is not transmitted, 

20 the CPU 11 reads the continuous driving time S stored in the address "A1" in the RAM 13 and stores S ■ n1 obtained 
by multiplying a sleepiness judgment coefficient n1 to the continuous driving time S into an address "B1 " in the RAM 13 
as a sleepiness judgment parameter based on the driving elapsed time (step Si 01). 

The CPU 1 1 reads each of the azimuth distribution parameter 1/aa stored in the address "A8" in the RAM 13 and 
the speed distribution parameter a/ou stored in the address "A9" in the RAM 13 and stores (1/aa + 1/au) ■ n2 obtained 

25 by multiplying a sleepiness judgment coefficient n2 to the addition result obtained by adding those parameters into an 
address "B2" in the RAM 13 as a sleepiness judgment parameter based on a monotonousness of the driving (step 
S102). The CPU 1 T reads the present time T stored in the address "A6" in the RAM 13 and discriminates whether the 
present time T is a time within a range from 0 a.m. to 5 a.m. or a range from 1 p.m. to 3 p.m. or not (step S103). In step 
S103, if it is judged that the present time T is not the time within a range from 0 a.m. to 5 a.m. or a range from 1 p.m. to 

30 3 p.m., the CPU 1 1 reads the sleepiness occurrence times T1 and T2 stored in the addresses "AC" and "AD" in the RAM 
13 and judges whether the present time T is a time within a range from the sleepiness occurrence time T1 to T2 or not 
(step S1 04). 

When it is judged in step S103 that the present time T is a time within a range from 0 a.m. to 5 a.m. or a range from 
1 p.m. to 3 p.m. or when it is judged in step S104 that the present time T is a time within a range from the sleepiness 

35 occurrence time T1 to T2, the CPU 1 1 stores a sleepiness judgment coefficient n3 into address "B3" in the RAM 13 as 
a sleepiness judgment parameter based on the driving time zone (step S105). When it is judged in step S104 that the 
present time T is not a time within a range from the sleepiness occurrence time T1 to T2, the CPU 1 1 stores 0 into an 
address "B3" in the RAM 13 (step S 106). After completion of step S 105 or S 106, the CPU 11 reads each of the MWSA 
value stored in the address "A4" in the RAM 13 and the RSA value stored in the address "A5" in the RAM 13 and stores 

40 (RSA/MWSA) ■ n4 obtained by multiplying a sleepiness judgment coefficient n4 to the division result obtained by dividing 
the RSA value by the MWSA value, into an address "B4" in the RAM 13 as a sleepiness judgment parameter based on 
an autonomic nervous system (step S107). 

The CPU 11 reads the present running road information D stored in the address "AB" in the RAM 13 and stores 
D • n5 obtained by multiplying a sleepiness judgment coefficient n5 to the present running road information D into an 

45 address "B5" in the RAM 1 3 as a sleepiness judgment parameter based on the running road situation (step S108). The 
CPU 1 1 stores a sleepiness judgment value Pn obtained by adding the sleepiness judgment parameters stored in the 
addresses "B1" to "B5" in the RAM 13 as mentioned above into an address "B6" in the RAM 13 (step S109). Namely, 
by the execution of step S109, 

so Sleepiness judgment value Pn = S • n1 + (1/aa + 1/au) • n2 + n3 + (RSA/MWSA) • n4 + D - n5 (1) 



. is stored into an address "B6" in the RAM 13. 

The CPU 1 1 judges whether the sleepiness judgment value Pn stored in the address "B6" in the RAM 13 is larger 
than a sleepiness judgment threshold value SN or not (step S1 10). When it is judged in step S1 10 that the sleepiness 



or 



Sleepiness judgment value Pn = S • n1 + (1/aa + 1/au) • n2 + (RSA/MWSA) ■ n4 + D • n5 



(2) 
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judgment value Pn is larger than the sleepiness judgment threshold value SN, the CPU 1 1 starts to execute a next 
sleepiness alarm subroutine (step S1 1 1). 

In the sleepiness alarm subroutine, the CPU 1 1 supplies a play start instruction signal to a CD player in the audio 
system 1 and also supplies a high speed play instruction signal to raise a playing speed of the CD player. Further, the 

5 CPU 1 1 supplies a volume increase instruction signal to raise a sound volume of an amplifier in the audio system 1 . 
The CPU 1 1 also supplies high and low frequency sounds increase instruction signal in order to increase high and low 
frequency sound components, to an equalizer in the audio system 1 . By the above series of operations, the music piece 
in which the sound volume is large and the high and low frequency sounds are emphasized is generated as a sound at 
a playing speed higher than the ordinary speed. 

10 In the above sleepiness alarm subroutine, the CPU 1 1 supplies a room temperature decrease instruction signal to 
the air conditioner system 2. In accordance with the room temperature decrease instruction signal, the air conditioner 
system 2 blows out a cool wind in order to reduce the temperature in the room by only a predetermined temperature 
than the present room temperature. The air conditioner system 2 adjusts the direction of the blowing ports so that the 
cool wind is directly blown to the driver. In the sleepiness alarm subroutine, the CPU 1 1 supplies a sleepiness alarm 

is instruction signal to each of the alarm sound generating apparatus 4 and display 5. In response to the sleepiness alarm 
instruction signal, the alarm sound generating apparatus 4 generates a message, by a voice, to warn the driver of a fact 
that he is sleepy. On the other hand, in response to the sleepiness alarm instruction signal, the display 5 displays a 
message to warn the driver of a fact that he is sleepy. In the sleepiness alarm subroutine, the CPU 1 1 supplies a perfume 
generation instruction signal to the perfume generating apparatus 6. The perfume generating apparatus 6 generates a 

20 stimulus perfume into the vehicle room in response to the perfume generation instruction signal. 

Namely, in the sleepiness judging subroutine shown in Fig. 12, the continuous driving elapsed time, monotonousness 
of the driving, driving time zone, and autonomic nervous state of the driver are used as parameters for judgment of the 
sleepiness and they are judged, thereby discriminating whether the driver feels sleepy or not. 

For example, when the continuous driving time is long, or when the value of S * n1 that is calculated in step S101 

25 is large, a probability such that a sleepiness occurs is large. When the number of azimuth changing times of the vehicle 
per unit time and the number of accelerating times of the vehicle is reduced and the driving becomes monotonous, that 
is, when the value of (1/aa + 1/au) • n2 that is calculated in step S102 is large, a probability such that the sleepiness 
occurs is large. When the driving time zone is a midnight, such a probability is large. In the above embodiment, when 
the driving time zone lies within a range from 0 a.m. to 5 a.m. or a range from 1 p.m. to 3 p.m., the sleepiness judgment 

30 coefficient n3 is added as a sleepiness judgment parameter. In the embodiment, even when the driving time zone is out 
of a range from 0 a.m. to 5 a.m. or a range from 1 p.m. to 3 p.m., so long as the driver himself is aware of the sleepiness 
and pushes the sleepiness time zone setting switch 7, the time zone of 0.5 hour before and after the time when the 
switch 7 was pushed is stored as a sleepiness time zone (steps S91 to S93). Finally, only when the vehicle is driven in 
the time zone within a range from 0 a.m. to 5 a.m. or a range from 1 p.m. to 3 p.m. and the sleepiness time zone sets 

35 as mentioned above, the sleepiness judgment coefficient n3 is added as a sleepiness judgment parameter (steps S103 
toSl06). & 

When the RSA value as an activity index of the parasympathetic system increases and the MWSA value as an 
activity index of the sympathetic system decreases, a possibility in which the sleepiness occurs in the driver is large. 
When the driver feels sleepy, therefore, the value of (RSA/MWSA) • n4 that is calculated in step S107 is large. 

40 During the driving of a freeway as compared with an ordinary road, a possibility such that a momentary sleepiness 
causes an accident is high. In the above embodiment, therefore, the information obtained by multiplying the sleepiness 
judgment coefficient n5 to the present running road information D indicating whether the road on which the vehicle is 
running at present is the freeway or not is added as a sleepiness judgment parameter. Since the present running road 
information D is set to a logic value "1" in case of the freeway as a present running road and is set to a logic value "0" 

45 in case of an ordinary road, eventually, only when the road on which the vehicle is at present running is the freeway, the 
sleepiness judgment coefficient n5 is added as a sleepiness judgement parameter. In the above embodiment, the sleep- 
iness judgment parameter of the sleepiness judgment coefficient n5 is added in dependence on whether the road on 
which the vehicle is at present running is the ordinary road or the freeway. The invention, however, is not limited to such 
a construction. For example, it is also possible to construct in a manner such that information indicating whether the 

so vehicle approaches a region where an accident frequently occurs or not is read out from the navigation system 3 as 
present running road information D and only when the present running road approaches the many-accident occurring 
region, a sleepiness judgment coefficient n6 is newly added as a sleepiness judgment parameter. 

In the sleepiness judging subroutine, when the sleepiness judgment value Pn obtained by adding the above sleep- 
iness judgment parameters is larger than the predetermined sleepiness judgment threshold value SN (steps S109 and 

55 S1 10), it is finally judged that the sleepiness occurs in the driver, so that a sleepiness warning is performed (step S1 1 1). 
After completion of the sleepi ness alarm subroutine in step S1 1 1 or when it is judged in step S1 1 0 that the sleepiness 
judgment value Pn stored in the address "B6" in the RAM 13 is not larger than the sleepiness judgment threshold value 
SN, the CPU 1 1 is returned to the execution of the main flow as shown in Fig. 10 and starts to execute a next fatigue 
judging subroutine (step S1 5). 
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Fig. 13 is a flowchart showing a flow for a fatigue judging subroutine. 

In Fig. 13, the CPU 1 1 first reads the continuous driving time S stored in the address "A1" in the RAM 13 and stores 
S ■ hi obtained by multiplying a fatigue judgment coefficient hi to the continuous driving time S into an address "B7" in 
the RAM 13 as a fatigue judgment parameter based on the driving elapsed time (step S121). 
s Subsequently, the CPU 1 1 reads each of the initial heartbeat number HRs stored in the address "A2" in the RAM 

1 3 and the present heartbeat number HR stored in the address "A3" in the RAM 1 3 and stores (HRs - HR) ■ h2 obtained 
by multiplying a fatigue judgment coefficient h2 to the subtraction result obtained by subtracting them into an address 
"B8" in the RAM 13 as a fatigue judgment parameter based on the change in heartbeat number (step S122). 

The CPU 1 1 reads each of the MWSA value stored in the address "A4" in the RAM 13 and the RSA value stored 
w in the address "A5" in the RAM 13 and stores (MWSA/RSA) • h3 obtained by multiplying a fatigue judgment coefficient 
h3 to the division result obtained by dividing the MWSA value by the RSA value into an address "B9" in the RAM 13 as 
a fatigue judgment parameter based on the autonomic nervous system (step S123). 

The CPU 1 1 1 stores a fatigue judgment value Ph obtained by adding the fatigue judgment parameters stored in the 
addresses "B7" to "B9" in the RAM 13 as mentioned above into an address "BA" in the RAM 13 (step S124). Namely, 
15 by executing step S124, 

Fatigue judgment value Ph = S ■ hi + (HRs - HR) • h2 + (MWSA/RSA) • h3 (3) 

is stored in the address "BA" in the RAM 13. 
20 Subsequently, the CPU 1 1 judges whether the fatigue judgment value Ph stored in the address "BA" in the RAM 1 3 

is larger than a fatigue judgment threshold value SH or not (step S125). When it is judged in step S125 that the fatigue 
judgment value Ph is larger than the fatigue judgment threshold value SH, the CPU 1 1 starts to execute a fatigue alarm 
subroutine (step S126). 

In the fatigue alarm subroutine, the CPU 1 1 supplies the play start instruction signal to the CD player in the audio 
25 system 1 and also supplies the high speed play instruction signal in order to raise the playing speed of the CD player. 
Further, the CPU 11 supplies the sound volume increase instruction signal in order to raise the sound volume of the 
amplifier in the audio system 1 . The CPU 1 1 also supplies the high and low frequency sound increase instruction signal 
in order to increase the high and low frequency sound components, to the equalizer in the audio system 1 . By the above 
series of operations, the music piece in which the sound volume is large and the high and low frequency sounds are 
30 emphasized is generated, by a sound, at the playing speed higher than the ordinary speed. 

In the fatigue alarm subroutine, the CPU 1 1 supplies a fatigue alarm instruction signal to each of the alarm sound 
generating apparatus 4 and display 5. In response to the fatigue alarm instruction signal, the alarm sound generating 
apparatus 4 generates a message, by a voice, to make the driver active. For instance, the alarm sound generating 
apparatus 4 generates a message, by a voice, to advise a light exercise to the driver in response to the fatigue alarm 
35 instruction signal. 

Namely, in the fatigue judging subroutine shown in Fig. 13, the continuous driving elapsed time, change in heartbeat 
number of the driver, and autonomic nervous state of the driver are used as parameters for the judgment of the fatigue 
and they are judged, thereby discriminating whether the driver feels a fatigue or not. 

For example, when the continuous driving time is long, namely, when the value of S • hi that is calculated in step 
40 S1 21 is large, a probability in which the driver is tired is high. When the number of heartbeats decreases, namely, when 
the value of (HRs - HR) ■ h2 that is calculated in step S1 22 is large, a possibility in which the driver is in a tired state 
is high. When the RSA value as an activity index of the parasympathetic system is small and the MWSA value as an 
activity index of the sympathetic system is large, namely, when the value of (MWSA/RSA) ■ h4 that is calculated in step 
S123 is large, a possibility such that the driver is tired is high. 
45 In the fatigue judging subroutine, when the fatigue judgment value Ph obtained by adding the above fatigue judgment 

parameters is larger than the predetermined fatigue judgment threshold value SH (steps S124 and S125), it is finally 
judged that the driver is tired, so that a fatigue alarm is performed (step S126). 

After completion of the fatigue alarm subroutine in step S126 or when it is judged in step S125 that the fatigue 
judgment value Ph stored in the address "BA" in the RAM 1 3 is not larger than the fatigue judgment threshold value SH, 
so the CPU 1 1 is returned to the execution of the main flow as shown in Fig. 1 0 and starts to execute an impatience judging 
subroutine (step S16). 

Fig. 14 is a flowchart showing a flow for the impatience judging subroutine. 

In Fig. 14, the CPU 1 1 first reads the continuous driving time S stored in the address "A1" in the RAM 13 and the 
movement distance L stored in the address "AA" in the RAM 13 and divides the continuous driving time S by the move- 
55 ment distance L, thereby obtaining the inverse number of the movement distance per unit time. Further, (S/L) ■ e1 
obtained by multiplying an impatience judgment coefficient e1 to the reciprocal number of the movement distance per 
unit time is stored in an address "BB" in the RAM 13 as an impatience judgment parameter based on the movement 
distance per unit time (step Si 31). The CPU 1 1 reads each of the MWSA value stored in the address "A4" in the RAM 
13 and the RSA value stored in the address "A5" in the RAM 13 and stores (MWSA/RSA) ■ e2 obtained by multiplying 
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an impatience judgment coefficient e2 to the division result obtained by dividing the MWSA value by the RSA value into 
an address "BC" in the RAM 13 as an impatience judgment parameter based on the autonomic nervous system (step 
S132). 

The CPU 1 1 subsequently stores an impatience judgment value Pe obtained by adding the impatience judgment 
5 parameters stored in the addresses "BB" and "BC" in the RAM 13 into an address "BD" in the RAM 13 (step S133). 
Namely, by executing step S1 33, 



10 is stored in the address "BD" in the RAM 13. 

The CPU 1 1 judges whether the impatience judgment value Pe stored in the address "BD" in the RAM 13 is larger 
than an impatience judgment threshold value SE or not (step S134). When it is judged in step S134 that the impatience 
judgment value Pe is larger than the impatience judgment threshold value SE, the CPU 1 1 starts to execute an impatience 
alarm subroutine (step S135). 

is In the impatience alarm subroutine, the CPU 1 1 supplies a low speed play instruction signal to the CD player in 
order to reduce the playing speed of the CD player in the audio system 1 . Further, the CPU 1 1 supplies a sound volume 
decrease instruction signal in order to reduce the sound volume of the amplifier in the audio system 1. The CPU 11 
supplies high and low frequency sound decrease instruction signal to reduce the high and low frequency sound com- 
ponents to the equalizer in the audio system 1 . By the above series of operations, the sound volume of the music piece 

20 reproduced is reduced and, further, the playing speed is reduced than the ordinary speed. 

In the impatience alarm subroutine, the CPU 11 supplies the impatience alarm instruction signal to each of the 
alarm sound generating apparatus 4 and display 5. In response to the impatience alarm instruction signal, the alarm 
sound generating apparatus 4 generates a message, by a voice, to soothe the nerves of the driver. For example, in 
response to the impatience alarm instruction signal, the alarm sound generating apparatus 4 generates a message, by 

25 a voice, to advise a deep breath to the driver. In the impatience alarm subroutine, the CPU 11 supplies a perfume 
generation instruction signal to the perfume generating apparatus 6. The perfume generating apparatus 6 generates a 
perfume such as to suppress the excited nerves into the vehicle room. tt 

Namely, in the impatience judging subroutine shown in Fig. 14, the value of the inverse number of the movement 
distance of the vehicle per unit time and the autonomic nervous state of the driver are used as parameters jor the 

30 judgment of the impatience and they are judged, thereby discriminating whether the driver is nervous or not. 

For example, when the inverse number value of the movement distance of the vehicle per unit time, namely, the 
value of (S/L) * e1 that is calculated in step S1 31 is large, a probability such that a nervous feeling of the driver increases 
is high. When the RSA value as an activity index of the parasympathetic system is small and the MWSA value as an 
activity index of the sympathetic system is large, namely, when the value of (MWSA/RSA) ■ e2 that is calculated ,in step 

35 S132 is large, a possibility such that the driver is nervous is high. 

In the impatience judging subroutine, when the impatience judgment value Pe obtained by adding those impatience 
judgment parameters is larger than the predetermined impatience judgment threshold value SE (steps S133 and S134), 
it is finally judged that the driver is nervous, so that an impatience alarm is performed (step S135). 

After completion of the impatience alarm subroutine in step S1 35 or when it is judged in step S1 34 that the impatience 

40 judgment value Pe stored in the address "BD" in the RAM 1 3 is not larger than the impatience judgment threshold value 
SE, the CPU 1 1 is returned to the execution in step S4 of the main flow as shown in Fig. 9 and repetitively executes the 
operations as mentioned above. 

As mentioned above, in the driving mental condition detection, first, by executing steps S4 to S7 of the main flow, 
various kinds of physiological data of the driver during the driving of the vehicle, namely, the heartbeat number HR, 

45 MWSA value, and RSA value are collected, respectively. By executing next steps S8 to S13, the real travel data of the 
vehicle, namely, the continuous driving time S, azimuth distribution parameter 1/aa, speed distribution parameter 1/au, 
present running road information D, and movement distance L are respectively measured. By executing next steps S14 
to S16, a deterioration state of the driving mental conditions of the driver, namely, sleepiness, fatigue, and impatience 
of the driver are detected. That is, when it is judged that the sleepiness occurs in the driver on the basis of the physiological 

so data of the driver and the real travel data of the vehicle, the sleepiness alarm by the execution in step S1 1 1 is performed. 
When it is judged that a fatigue occurs in the driver on the basis of the physiological data and the real travel data of the 
vehicle, the fatigue alarm by the execution in step S1 26 is performed. When it is judged that the driver is nervous on the 
basis of the physiological data and the real travel data of the vehicle, the impatience alarm by the execution in step S135 
is performed. 

55 In the embodiment of Fig. 3, one MT pickup 8 has been attached to the seat belt 82. As shown in Figs. 15 to 17, 
however, a plurality of MT pickups can be also provided at different positions on the seat belt 82. 

Fig. 15 is a diagram showing an example in case of attaching two MT pickups 8a and 8b at two positions on the 
seat belt 82 to come into contact with the driver. 



Impatience judgment value Pe = (S/L) ■ e1 + (MWSA/RSA) • e2 



(4) 
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Fig. 18 is a diagram showing an example of a construction of the heartbeat detecting circuit 9 that is used when the 
MT pickups as shown in Fig. 15 are formed. 

In Fig. 18, skin vibration signals S1 and S2 supplied from the MT pickups 8a and 8b are supplied to amplifiers 91a 
and 91b, respectively. The amplifier 91a, the BPF 92a, a peak holding circuit 93a, and an LPF 94a in Fig. 18 and, further, 

s the amplifier 91b, the BPF 92b, a peak holding circuit 93b, and an LPF 94b have the same construction as that of the 
amplifier 91 , BPF 92, peak holding circuit 93, and LPF 94 shown in Fig. 4. The skin vibration signal S1 supplied from 
the MT pickup 8a, therefore, is converted to the heartbeat signal by the construction comprising the amplifier 91a, BPF 
92a, peak holding circuit 93a, and LPF 94a and is supplied to a comparator 96 and a selector 97. The skin vibration 
signal S2 supplied from the MT pickup 8b is converted to the heartbeat signal by the construction comprising the amplifier 

w 91 b, BPF 92b, peak holding circuit 93b, and LPF 94b and is supplied to the comparator 96 and selector 97. A construction 
comprising the comparator 96 and selector 97 selects the heartbeat signal at the high level from the heartbeat signals 
supplied from the LPFs 94a and 94b and supplies the selected heartbeat signal to the A/D converter 95. 

Namely, according to the constructions as shown in Figs. 15 and 18, the heartbeat signal is detected by using the 
skin vibration signal of a higher detecting sensitivity in the skin vibration signals which are generated from the two MT 

15 pickups 8a and 8b. 

Fig. 16 is a diagram showing an example, in the two MT pickups 8a and 8b, when the MT pickup 8a is formed at 
the position where it is not come into contact with the driver and the MT pickup 8b is formed at the position on the seat 
belt 82 where the pickup 8b is come into contact with the driver. 

Fig. 1 9 is a diagram showing an example of the construction of the heartbeat detecting circuit 9 using the MT pickups 
20 as shown in Fig. 16. 

In Fig. 19, the skin vibration signals S1 and S2 supplied from the MT pickups 8a and 8b are supplied to a subtracter 
98 through the amplifiers 91a and 91b. The subtracter 98 subtracts the levels of the supplied signals and supplies the 
resultant subtraction skin vibration signal to the BPF 92. The construction of the BPF 92, peak holding circuit 93, LPF 
94, and A/D converter 95 has the same function as each functional module shown in Fig, 4. 
25 Namely, according to the constructions as shown in Figs. 16 and 19, a noise component of the same phase multi- 
plexed to the skin vibration signal supplied from each of the MT pickup 8a provided at the position where it is not come 
into contact with the driver and the MT pickup 8b provided at the position where it is come into contact with the driver is 
reduced. 

Fig. 1 7 is a diagram showing an example, among three MT pickups 8a, 8b, and 8c, when the MT pickup 8a is formed 
30 at a position where it is not come into contact with the driver and the MT pickups 8b and 8c are formed at positions on 
the seat belt 82 where they are come into contact with the driver. 

Fig. 20 is a diagram showing an example of the construction of the heartbeat detecting circuit 9 using the MT pickups 
as shown in Fig. 1 7. 

In Fig. 20, the skin vibration signals S1 and S2 supplied from the MT pickups 8a and 8b are supplied to a subtracter 
35 98a through the amplifiers 91a and 91b. The subtracter 98a subtracts the levels of the supplied signals and supplies the 
resultant subtraction skin vibration signal to the BPF 92a. The construction of the BPF 92a, peak holding circuit 93a, 
and LPF 94a in Fig. 20 has substantially the same function as each functional module of the same reference numeral 
shown in Fig. 18. 

On the other hand, skin vibration signals S2 and S3 supplied from the MT pickups 8b and 8c are supplied to a 
40 subtracter 98b through amplifiers 91b and 91c, respectively. The subtracter 98b subtracts the levels of those supplied 
signals and supplies the resultant subtraction skin vibration signal to the BPF 92b. The construction comprising the BPF 
92b, peak holding circuit 93b, and LPF 94b in Fig. 20 has substantially the same function as that of each functional 
module of the same reference numeral shown in Fig. 18. The construction comprising the comparator 96 and selector 
97 selects the heartbeat signal at the high level from the heartbeat signals supplied from the LPF 94a and 94b and 
45 supplies the selected heartbeat signal to the A/D converter 95. 

Namely, according to the constructions as shown in Figs. 1 7 and 20, the heartbeat signal detection is performed by 
using the skin vibration signal of a higher detecting sensitivity while reducing the noise component of the same phase 
multiplexed to the skin vibration signal. 

In the driving mental condition detecting apparatus according to the invention as mentioned above, on the basis of 
so the physiological data of the driver and the road travel data of the vehicle derived from the navigation system, a deteri- 
oration state of the driving mental conditions of the driver, namely, sleepiness, fatigue, and impatience are detected, 
thereby promoting to warn to the driver. 

According to the driving mental condition detecting apparatus, therefore, even in a situation during the driving of the 
vehicle, a deterioration in driving mental conditions such as sleepiness, fatigue, and impatience of the driver can be 
55 accurately detected and when the deterioration in driving mental condition is detected, the detected result can be warned 
to at least the driver. 
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Claims 



5 



1. 



A driving mental condition detecting apparatus comprising: 

physiological data detecting means for detecting physiological data of a driver of a vehicle; 
navigation means for obtaining travel data of said vehicle; 



driving mental condition judging means for judging whether driving mental conditions of said driver has dete- 
riorated or not on the basis of said physiological data and .said travel data; and 

alarm generating means for generating an alarm when it is judged that said driving mental conditions have 
deteriorated. 

w 

2. An apparatus according to claim 1 , wherein said physiological data detecting means detects the number of heart- 
beats of said driver, an RSA( Respiratory Sinus Arrhythmia) value, and an MWS A (Mayer Wave related Sinus Arrhyth- 
mia) value as said physiological data. 

is 3. An apparatus according to claim 1 , wherein said navigation means obtains an accumulated travel distance of said 
vehicle, an azimuth change situation and a speed change situation of said vehicle, and present running road infor- 
mation corresponding to a road on which said vehicle is running as said travel data. 

4. An apparatus according to claim 3, wherein said present running road information is information indicating whether 
20 said vehicle is running on an ordinary road or a freeway. 

5. An apparatus according to claim 1 , wherein said driving mental condition state is a state indicative of a sleepiness, 
a fatigue, and an impatience occurring in said driver. 
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